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Abstract. Using results of a Monte Carlo simulation of the Sherrington-Kirkpatrick 
model, we try to characterise the slow disorder samples, namely we analyse visually 
the correlation between the relaxation time for a given disorder sample J with several 
observables of the system for the same disorder sample. For temperatures below T c but 
not too low, fast samples (small relaxation times) are clearly correlated with a small 
value of the largest eigenvalue of the coupling matrix, a large value of the site averaged 
local field probability distribution at the origin, or a small value of the squared overlap 
< q 2 >. Within our limited data, the correlation remains as the system size increases 
but becomes less clear as the temperature is decreased (the correlation with < q 2 > is 
more robust) . There is a strong correlation between the values of the relaxation time 
for two distinct values of the temperature, but this correlation decreases as the system 
size is increased. This may indicate the onset of temperature chaos. 
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The Sherrington-Kirkpatrick (SK) model has been intensively studied since the 
mid-seventies, when it was introduced [I] as a starting point for studying spin glasses. 
It has a low temperature spin glass phase, with a very slow dynamics and an equilibrium 
relaxation time that diverges when the number of sites N goes to infinity. The value of 
the equilibrium relaxation time r depends strongly on the disorder sample J, and r is 
not self averaging (namely E{j 2 ) — E(r) 2 /E(t) 2 , where E(-) is the disorder average, 
does not go to zero as iV — > oo). There are now reasonable evidences, both analytical 
and numerical (see [21 [3] and references therein) that, in the low temperature phase 
of the model, the disorder average of the logarithm of the equilibrium relaxation time 
E(\ar) grows like iV 1//3 as N grows, and that the probability density function of lnr 
scales according to the equation P(lnr) = N~^F((lnr — E (In t))/N^), with some 
N independent function F(-) with zero mean, and ip = 1/3, although it has been 
argued (U [5] that ip may be slightly less than 1/3 (In such a case lnr would be weakly 
self averaging). 

Whether tjj is equal to 1/3 or slightly less than 1/3, there are definitively disorder 
samples with extremely slow dynamics. Our aim in this note is to try to characterise 
these "slow samples". We have two motivations in mind, one theoretical and the 
other more down to earth. The first motivation is the question of the behaviour of 
F(x) for large values of the argument x. It has been argued in |3] that F(x) has an 
exponential behaviour with hxF(x) oc — x v for large x. If furthermore the tail of F(x) 
is dominated by rare disorder samples with small probability oc exp(— AN a ) and an 
anomalously large free energy barrier oc (with (3 > 1/3), the exponents a, (3, ip and 
rj fulfil [1] the consistency relation ((3 — ip)r] = a. For example, a dominance by the 
rare samples with all exchange couplings Jjj positive (up to a gauge transformation, 
see later) would correspond to a = 2, and (3 = 3/2. The value ip — 1/3 would then 
imply that rj = 12/7. This value for rj is however not compatible with the numerical 
results of jl] for the distribution P(logr). In this reference arguments are given for the 
values a = /3 = l,V' = l/4 (and accordingly 77 = 4/3) instead. The second motivation 
for the characterisation of the slow samples is of practical matter for Monte Carlo 
simulations: The vast majority of the Monte Carlo simulations of disordered systems 
in the literature use the same number of iterations for all disorder samples 0. There is 
accordingly a danger that some rare slow disorder samples are not thermalized. One is 
led naturally to the idea of concentrating the computational effort on the hard samples, 
that may require orders of magnitude more iterations than the mainstream disorder 
samples. Since the measurement of the relaxation time for every disorder sample is very 
time consuming, any heuristic method to pinpoint the slow samples can be valuable. 

The numerical method used is similar to the one used in [3]. We consider the SK 
model with binary exchange couplings, and the Hamiltonian 

n = -- J2 J id a i a 3 > (!) 

% For counter examples where the CPU time is adjusted to the disorder sample sluggishness see [B] 
or 0. 
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with crj = ±1, Jij = ±l/y/N. We measure the dynamic overlap 



1 N 

q d (t) = -T7X/°i(*o)°i(* + *o) , 



(2) 



i=l 



averaged along a very long trajectory (namely averaging over many values of to), with 
the Metropolis dynamics, starting from a well equilibrated spin configuration (obtained 
with the parallel tempering algorithm). Obviously ^(0) = 1 and qdif) decreases 
continuously towards zero, as t grows. We define the relaxation time r by the equation 



<ld(t = t) = 1/2JE(< q 2 >), where q is the usual (J dependent) overlap between two 



replica. Here we depart from [3] where a definition involving < q 2 >, with no disorder 
average, was used. Indeed, since we are looking for correlations between the value of In r 
and other J dependent quantities (including < q 2 > itself), it seems more appropriate 
to define r using a sample independent condition. The parameters of the simulations 
are such that our estimates of lnr have negligible thermal noise, as compared to the 
disorder sample to disorder sample fluctuations (see [3] for details). That the thermal 
noise is tamed is an essential condition for our analysis. We have data for N = 64 to 
512, 1024 disorder samples, and temperatures T = 0.4, 0.5, . . . (The critical temperature 



Note that as in [3] we do not measure relaxation times larger than some t win d ow ~ 
3.7 10 6 (and t window fh 1.7 10 6 for N = 512.). For a given couple N and T, the disorder 
samples with relaxation time larger than t W i n d ow are thus "censored". By convention, 
lnr = — 1 for such samples, namely minus one means overflow. Note that the real lnr 
is never equal to minus one (our relaxation times are integers). 

As explained just before, we found it more proper to define the relaxation time using 
a condition involving the disorder averaged E(< q 2 >) rather than < q 2 > as was done 
in [3] . It turns out however that this makes little difference as shown in figure [1] where 
we compare the two definitions in the case N = 128, T = 0.4. The same conclusion 
holds for other couples of iV and T. On close look, one notices that for low values of 
lnr the definition used here gives systematically lower results than the one used in [3]. 
This is explained by the fact that low values of In r are strongly correlated to low values 
of < q 2 > (see later in the text and figure [5]). This small systematic difference between 
the two definitions of the relaxation time disappears when In r grows. 

The first question we would like to address is whether the tail of the distribution 
P(lnr) is dominated by ferromagnetic disorder configurations. In order to proceed, 
we need a measure of the ferromagnetic character of a disorder configuration. The 
sum Ji,j is n °t a suitable indicator since it is not invariant under the local gauge 
symmetry of the model cr^ — y e^i, J^j — > e^Jij with = ±1, whereas the dynamics is 
invariant under this symmetry. Said another way, for every disorder configuration with 
all > 0, there is a huge number of 2 N — 1 other gauge transformed configurations 
with the same value of lnr (and the same weight) but a different value of J2i^jJi,j, 
and any correlation is washed out. (We nevertheless checked that there is indeed no 
sign of correlations between lnr and Yj&j Jij i n our data). A better indicator of the 




is T c = 1). 
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Figure 1. Plot of lnr, as measured using the definition of this note, as a function of 
the value obtained using the definition used in [3J. Here N = 128 and T = 0.4. The 
straight line is the diagonal. There are no disorder samples with r > t W mdow in the 
data. 



ferromagnetic character of a disorder configuration, that has been proposed in [5] , is the 
largest eigenvalue A at of the matrix {Jij}- In the SK model the diagonal elements of 
this matrix are not used, but they are obviously needed however in order to compute 
the eigenvalues of the matrix, and we have set them equal to zero. Our results for the 
correlation between lnr and A at can be found in figure [2] for iV = 64 and T = 0.8. The 
points on the x axis are concentrated around the value two, in agreement with random 
matrix results for the GOE with the normalisation ^(J^) = 1/N for i ^ j (in the GOE 
the diagonal elements are random with £"(7^) = 2/N, and not identically zero, but this 
should not change the asymptotic behaviour). There is a clear correlation between low 
values of A at and low values for lnr, but this correlation becomes fuzzy as A a? grows. 
We were looking for a characterisation of the slow disorder samples but we found a 
characterisation of the fast disorder samples instead. 

The scatter plots become progressively harder to interpret as N grows and / or T 
decreases, since we are missing more and more points that correspond to censored values 
of lnr. One can nevertheless conclude from our data that the correlation remains as the 
system size increases, but becomes more fuzzy as temperature is decreased. (The neat 
correlation seen in the left of figure |2] fades away as the temperature is decreased). The 
net conclusion is that there is in our data no visible dominance of the large relaxation 
region by ferromagnetic disorder samples [§|. This is in agreement with the findings of jl] 
for the tail of the distribution of lnr. 

In the spherical SK model [8] the relaxation time is fixed by the difference between 
the two largest eigenvalues of the {Jij} matrix, through the equation 

lnr = jV/(2T)(l - T)(X N - X N ^) . (3) 

For the SK model with binary couplings we consider here, the correlation between In r 
and Aat — Aat_i is more fuzzy, as one can see in figure [3j It is in fact fuzzier than the 

§ Although one may always argue that truly ferromagnetic disorder samples correspond to Ajv of order 
y/~N, deep in the tail of the distribution that we do not see due to limited statistics. 
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relation between lnr and alone. This is true for all values of N and T considered, 
and for all values of lnr (both large and small). Note that in the spherical SK model, 
equation [3] is used to prove that E'(lnr) oc iV 1//3 . It turns out [2] that this scaling holds 
also in the usual SK model although equation [3] does not hold. 




Figure 2. The logarithm of the relaxation time as a function of the largest eigenvalue 
An of the {Jij} matrix for N — 64 and T = 0.8. There are no disorder samples with 
t > t window in the data. 
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Figure 3. The logarithm of the relaxation time as a function of the gap between the 
two largest eigenvalues of the {Jij} matrix for N = 64 and T = 0.8. There are no 
disorder samples with r > t W i n dow in the data. 

In the spirit of we have also looked at the correlation between lnr and the site 
averaged local field probability distribution P{hi oca i) 

P(h local ) = ^(<E^-E Jyo-i) >) • ( 4 ) 

i j^i 

Specifically we looked at the correlation between lnr and the value of P(hi oca i) at the 
origin. Our results can be found in figure H] for N = 64 and T = 0.8. In [3| it was 
argued that the disorder samples with large relaxation times are the ones with all local 
fields (on every site i) large. This is indicative of a correlation between large values of 
lnr and a distribution Pthiocai) that is depleted at the origin. (Indeed [10] lnr increases 
as T decreases, while P{hi OC ai = 0) decreases as T decreases, with P{hi OC ai = 0) = 
at zero temperature in the N = oo limit). Our data indeed show a neat correlation 
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between large values of P(hi oca i = 0), and small lnr, but this correlation becomes fuzzy 
for lower values of P(hi oca i = 0). Again we were looking for a characterisation of the slow 
disorder samples but we found a characterisation of the fast disorder samples instead. 
The observed correlation seems to persists as N grows, but fades as T is decreased. 
There is a similar correlation between In r and the average value of hi oca i within the tail 
of P{h[ oca [), for example within the last five percents of the distribution. A small value 
of hi oca i inside the tail is correlated to a small relaxation time. 
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Figure 4. The logarithm of the relaxation time as a function of P(hi oca i = 0) for 
N = 64 and T = 0.8. The normalisation is such that J Q dhi oca iP(hi oca i) — 1. There 
are no disorder samples with r > t W i n dow in the data. 

The strongest correlation we found is between In r and the average overlap squared 
< q 2 >, as can be seen in figure [5j The observed correlation seems to persists as N 
grows, and as T is decreased. This correlation is an empirical finding and we have no 
dynamical explanation for it. On the other hand < q 2 > is fairly easy to estimate 
with Monte Carlo, even with little statistics and this correlation could be used to flag 
slow samples in numerical simulations. We finally remark that if there is a correlation 
between lnr and the average overlap squared < q 2 >, there is no correlation between 
lnr and the number of peaks in the order parameter distribution P(q). We have looked 
for such a correlation using the data of [9] , where the number of peaks was estimated for 
a subset of the disorder samples considered here. The presence of thermal noise in the 
measured distribution makes it difficult to count the number of peaks. In this reference 
the authors did their best to count the number of peaks by visual inspection of the plots 
of P(q) for 192 disorder samples, with T = 0.4. We find no correlation between the 
value of lnr and the number of peaks for N = 64 and 256. 

We have found finally that, disorder sample by disorder sample, the relaxation time 
measured at two temperatures (both in the spin glass phase) are strongly correlated. 
This can be seen in figure |6] where we show In r(T = 0.5) as a function of In r(T = 0.6) 
both for N = 64. This figure shows a very strong correlation. One notice a couple 
of samples for which In r(T = 0.5) = —1 (censored data). Figure [7] shows the same 
figure but with all systems sizes together. Obviously there are more and more disorder 
samples censored as N grows, with now a whole horizontal segment with lnr = — 1. 
Interestingly all points in the scatter plot scale on the same iV independent thick 
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Figure 5. The logarithm of the relaxation time as a function of < q 2 > for N — 64 
and T = 0.8. There are no disorder samples with r > t win( i ow in the data. 

line. This thick line would extend further towards large values had we used a larger 
observation window. (But it would be quite CPU time consuming to obtain a large 
extension). Note that the iV = 512 data appear to be more scattered than the other 
data, an optimistic interpretation is that we are seeing some onset of a temperature 
chaotic behaviour. In order to be more quantitative, we have analysed the data as 
follows: first we made a linear least squares fit of the iV = 64 data to the form 
In r(T = 0.5) = a + b In r(T = 0.6), with parameters a and b (we obtain the values 
a = 0.195 and b = 1.297). Then we computed, for every system size N, the deviation 
6% = l/(JVj(l + 6 2 ))Ej(« + b\nr(T = 0.6) - lnr(T = 0.5)) 2 , with the values of a 
and b obtained from the fit of the N = 64 data, an a sum over those disorder samples 
such that both relaxation times are less than t win do W (N / '512) 1 / 3 , with t win dow the cutoff 
used for the N = 512 data, and Nj the number of disorder samples that satisfy the 
constraint. In words, 5% is the mean squared deviation from the linear squares fit, 
taking properly into account the relaxation time observational cutoff. We find that 
Sn/N 1 /' 3 = 0.0423, 0.0485, 0.0509 and 0.0568 for N = 64, 128, 256 and 512 respectively. 
The correlation between the values of lnr at two temperatures becomes looser as iV 
grows, confirming quantitatively the indication of the onset of temperature chaos. 
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Figure 6. Logarithm of the relaxation time for T = 0.5 as a function of the logarithm 
of the relaxation time for the same disorder sample J but T = 0.6. The number of 
sites is N = 64. There are a couple of disorder samples with r > t W i n d ow for T = 0.5 
in this figure. Those are the points with Iht = — 1 (by convention). 
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Figure 7. (Colour on line) Same as in figure [5] but with N — 64, 128,256 and 512 
together. There are a couple of disorder samples with r > t W i nc i ow for both T = 0.5 
and T — 0.6 in this figure. Those are the points with lnr = — 1 (by convention). 

In conclusion, we have measured the equilibrium relaxation time r of the 
Sherrington-Kirkpatrick model with binary couplings for many samples of the quenched 
disorder, and several values of the temperature, with system sizes from N = 64 to 512, 
taking great care that the thermal noise is negligible. We confirm the result of [4] that 
the slow samples are not correlated to "ferromagnetic" disorder configurations, but we 
did not find evidence for a dominance by configurations with a small value at the origin 
of the site averaged local field probability distribution. We find a strong correlation 
between the relaxation times measured at two distinct values of the temperature (with 
the same disorder sample). Closer look shows a broadening as N grows, that is possibly 
an indication of the onset of temperature chaos. 
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